arXiv:1505.07981v2 [math.ST] 5 Dec 2015 


Limits of Kalman Filter application in heavy tailed 

problems 


Valentin Konakov *and Pavel Mozgnnov^ 

International Laboratory of Stochastic Analysis and Its Applications 
National Research University Higher School of Economics 

Moscow, Russia 


AHHOTaU,HH 

[^In this paper we consider the behavior of Kalman Filter state estimates in the case 
of distribution with heavy tails .The simulated linear state space models with Gaussian 
measurement noises were used. Gaussian noises in state equation are replaced by components 
with alpha-stable distribution with di erent parameters alpha and beta. We consider the 
case when "all parameters are known "and two methods of parameters estimation are 
compared: the maximum likelihood estimator (MLE) and the expectation- maximization 
algorithm (EM). It was shown that in cases of large deviation from Gaussian distribution 
the total error of states estimation rises dramatically. We conjecture that it can be explained 
by underestimation of the state equation noises covariance matrix that can be taken into 
account through the EM parameters estimation and ignored in the case of ML estimation. 

AHHOTaU,HH 

*Electronic address: VKonakovOhse. ru 

^Electronic address: pmozgunovOgmail. com; corresponding author 

^IThe article was prepared within the framework of the Academic Fund Program at the National 
Research University Higher School of Economics (HSE) in 2014-2015(No 14-05-0007) and supported 
within the framework of a subsidy granted to the HSE by the Government of the Russian Federation 
for the implementation of the Global Gompetitiveness Program. 


1 



B flaHHOH pa6oTe paccMaTpHsaeTca noBeflenne KjiaccHHecKoro ajiropHTMa (PnjibTp 
KajiMana b cjiynae, Kor^a oiuhGkh HMeioT pacnpeflejieHne c THJKejiBiMH XBOCTaMH. /],jih 
3Toro 6bijia HcnojiBSOBana CHMyjiHpoBaHHaa MOflejiB, b KOTopoft myMBi Ha6jiK)fleHHH pac- 
npeflejieHBi HopMajiBHO, a myMBi HeHa6jiK)flaeMBix coctohhhh saMenenBi na oluhGkh, hmc- 
K)iii,He a-ycTOHHHBoe pacnpeflejieHne c flByMH MeHHK)iii,HMHCH napaMeTpaMH a ii /3. Ha- 
MH paccMOTpeno flBa cjiynaa: Kor^a Bce napaMeTpBi HSBecTHBi, h Kor^a hx Heo6xoflHMO 
OLi;eHHTB. oii,eHHBaHHH npHMeHHjiHCB MBTOfl MaKCHMajiBHOBo npaBflonofloGHH H EM- 

ajiropHTM. 3MnHpHHecKH 6bijio noKasano, hto b cjiynae Gojibiuhx OTKjioHeHHli ot nop- 
MajiBHOCTH, cpeflHHH OHinGKa opeHHBaHHH SHaHeHHH HenaGjiioflaeMBix nepeMenHBix 6bict- 
po pacTeT. Mbi npe^nojiaraeM, hto 3to moxcbt 6bitb o6B>HCHeHo HefloopenKoft MaTpHii,Bi 
KOBapHaii,HH B cjiynae, Kor^a Bce napaMeTpBi nsBecTHBi. Ho b cjiynae EM-opennBanHH oTa 
npo6jieMa mojkot 6bitb npeoflojiena. Hs pesyjiBTaTOB MOflejinpoBanna cjieflyeT, hto b hh- 
TepBajie a G [1.3, 2] mojkot 6bitb npnMenena cTanflapTnan npopeflypa (JnjiBTpa KajiMana 
H EM-oii,eHHBaHHe. Hbckojibko hbm nsBecTHO, noflpo6HBiH bbibo^ CrjiancHBannH KajiMana 
n EM-ajiropHTMa b pyccKonsBinnon jiHTepaType panee ne npnBOflnjicH. 


1 BBe,z];eHHe 

PaccMoxpHM flHCKpexHyio jiHHeHHyio Mo^ejib npocxpaHcxBa-cocxonHHH (linear state-space model); 


-^fc+i — AkXk + Vfc+i 

k = 0,l,... 

(1) 

n = CkXk + Wk 

e R"^, k = 0,l,... 

(2) 


r^e ypaBHenne (1) - ypaBnenne cocxohhhh, ypaBnenne (2) - ypaBnenne Hadjiio^eHnn. 

Xk - BeKxop nenadjiioflaeMBix nepeMenHBix, Yk - Benxop naGjno^aeMBix nepeMennBix. Ak - Max- 
pnpa m X 171] 14 - Mo^ejiBHBin myM c (jryHKpnen njioxnocxn /; Ck - Maxpnpa d x m] Wk 

- myM HaGjno^eHHH c (JryHKpneH njioxnocxn g; n aa^ano pacnpe^ejicnne nanajiBHoro Benxopa 
Xo. 

Bojinmoe KOJinnecxBo Mo;i;ejieH (b xom nncjie n co bccmh Ha6jiio;i;aeMBiMH nepeMennBiMn) 
Moryx 6 bixb npe^cxaBjieiiBi b bh^c auhcuhou mo^cjih npocxpancxBa cocxohhhh, cpe^n nnx: 
perpecHonnaH mo^cjib c MenmomnMHCH KoocJrcJrHpHeHxaMH (TVP), npopecc CKOJiBSHipero cpe^- 
nero - MA(q), aBxoperpeccnoHHBin npopecc - AR(p), mo^cjib aBxoperpeccnn — cKOJiBSHipero 


2 



cpe^Hero - ARM A (p,q), ceaoHHaH Mo^ejib c myMOM, ^HHaMKHecKaa (jDaKTopnaH Mo^ejit., ^h- 
HaMHHecKaH (JiaKTopHaH Mo^ejit c oGipHM cToxacTH^ecKHM xpeH^oM H MHorne ^pyrne Mo^ejiH. 

OcHOBHOH pejibio npH anajiHse Mo^ejieH npocxpancTBa coctohhhh aBjiaexcH opeHHBaHne 
(JiyHKpHH pacnpe^ejieHHH HenaCjiioflaeMoro Bexxopa Xk flJia Kaac^oro A;, ocnoBBiBaacB xojibko 
H a samyMjieHHBix Ha6jiiofleHH5ix: 

p { x ,\ yk ), ( 3 ) 

r^e = (j{Yq, Yk} - cr-ajire6pa, nopoHc^eHHaH HaGjuo^eHHHMH Yq, 

3xa aa^ana Gnuia pemena PyflojiB(|)OM KajiManoM b 1960 ro^y jl], b npe^nojioHceHHH, hxo 
Bce ohihGkh h pacnpe^ejieHHe HanajiBHoro Bexxopa rayccoBcxHe. IIpeflnojiojxeHHe o xom, hxo 
ohihGxh b ypaBHeHHHx rayccoBcxHe, cymecxBeHHo, h OnjiBxp KajiMana nepecxaex 6bixb ohxh- 
MajiBHBiM B cjiynae ne HopMajiBHBix ohihGox. 

U,ejiBio ^aHHOH pa6oxBi aBjinexcH oMnnpHHecxaH npoBepxa bosmojxhocxh npHMeneHHH Ohjib- 
xpa KajiMana ^jih Mo^ejieH c nerayccoBcxHMH oniHGxaMH. Bojiee xohho, Gbijio BBiOpano na- 
paMexpHHecxoe ceMencxBo pacnpe^ejieHHfl c xajxejiBiMH xBocxaMH, BxjiioHaioniee rayccoBcxoe 
pacnpe^ejieHHe, a HMenno: ceMeficxBo a-ycxoflHHBBix pacnpe^ejieHHH. B ^aHHofi pa6oxe hc- 
nojiBsoBaHBi npe^BapHxejiBHBie peayjiBxaxBi, oxpajxeHHBie b |12| . 

Pa6oxa opraHHaoBana cjie^yiomHM o6paaoM. Bo Bxopofi rjiaae Oy^ex ^an njian BBiBo^a 
ypaBHeHHH OnjiBxpa KajiMana h CrjiajxHBaHHH KajiMana, aaxeM Gy^ex onpe^ejiena ajincjia- 
ycxoHHHBan cjiynannaH BejiHHnna n onncan Mexo^ ee cHMyjinpoBaHHn, 6y^ex BBe^ena pac- 
CMaxpHBaeMan b paGoxe Mo^ejin. B xpexnen xjiaBe ^an xpaxxnn o6aop moxo^ob opennaannH 
napaMexpoB Mo^ejien npocxpancxBa cocxonnnn, nacxn BBiBo^a xoxopnix npHae^ena b npnjio- 
jxennnx. B nexBepxon xjiaBe npe^cxaBjicnni peayjinxaxni CHMyimpnli. Bbibo^bi c^ejianni b nnxon 
xjiaBe. 


2 Mo^ejib 

2.1 OHJibTp KajiMana 

KjiaccnnecxHH Onjinxpa KajiMana (OK) xopomo naBecxen, xom ne Menee, ji;jia yji;o6cxBa nnxa- 
xejiH, HHJxe xpaxxo najiojxena ocnoBnan nj^en j^annon npopej^ypni. 

PaccMoxpHM ypanneHnn npocxpancxBa cocxohhhh ( 1 ) n ( 2 ), npn cjieji,yioin;HX npeji;nojio>xe- 
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HHHX: 


Wo, Vi, Wi, V 2 , W 2 ... - HeaaBHCHMMe n;eHTpHpoBaHHt.ie rayccoBCKHe BexTopBi, E\ykVj*] = 
E[WkW(] = SkiRk, Xo ~ N{fi, S) H E[VkWi*] = 0 V A; h /. 

B 3TOM cjiynae Bexxopa Xk,Yk h Xk\yk AJih Bcex momchtob BpeMenn k Gy^yx hmbxb rayc- 
coBCKoe pacnpe^ejieHHe. Tax xax nopMajiBHoe pacnpe^ejieHne nojiHocxBio onpe^ejiHexca ^ByMH 
nepBBiMH MOMenxaMH, xo ^jih opeHHBanHH (3) ^jih Bcex k ^ocxaxoHHo HafixH: 

Xk\k = E[Xk\yk] 

= E[{Xk — Xk\k)iXk — Xk\k)*]- 

OcHOBHaa OnjiBxpa KajiMana (OK) cocxohx b paa^ejieHHH npope^ypxi opeHHBanHH Hena- 
BecxHoro Bexxopa cocxohhhh na ^Ba sxana: npe^cxaaaHHe h xoppexxnpoBxa. Hpope^ypa na- 
HHHaexcH c opeHHBaHHH Xo|o H So|o, ^0 ~ X { fi , T ,). HcnojiBsya cbohcxbo MHoroMepnoro nop- 
MajiBHoro pacnpe^ejieHHH, nojiy^HM: 

Xo|o = /i + SC'o^C'oSC'o* + Ro)-\Yo - Cofi) 

So|o = S - SC'o^C'oSC'o* + Ro)-^Coi:, 

r^e (CqSCo* + -Ro)~^ a^ecB h ^ajiee oGoanaHaex oCBrnnyio oGpaxnyio Maxpnpy, npn ycjioBHH ee 
cyrpecxBOBaHHH, hjih, b npoxHBHOM cjiynae, nceB^o-oGpaxHyio. /],o nocxynjienHH HaGjno^eHHH 
Ifc+i, "nporH03HpyeM"3HaHeHHe Bexxopa cocxohhhh b momcrx BpeMenn [k + 1), ncnojiBaya 
ypaBHeHHH (1), xo ecxx: 


Xk+i\k — E[Xk+i\yk] — AkXk\k 

^k+i\k = E[{Ak{Xk — Xk\k) + Vk+i){Ak{Xk — Xk\k) + Vk+i)*] = AkT^k\kAk* + Qk+i 

SaxeM nocxynaex HaGjno^eHne Yk + i - 06o3HaHHM 

d = Xk+i — E[Xk+i\yk] = Xk+i — Xk+i\k 

^ Yk-\-l |3^fc] 4c+l Yk-\-l\k 4c+l Ek-\-lXk-{-l\k ^k+1 

SaMexHM, Hxo (6*,^)- rayccoBcxHfi cjiyHafiHBm Bexxop, neaaBHCHMBm ox 3^^. 

Em = Em, 3 ^,] = E[e\yk+,] = Xk+I\k+1 - Xk+,\k 
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06o3HaHHM V KOBapHan;HOHHyio Maxpapy Bexxopa { 0 ,^): 

Vee Vg^ 

Ve^ 

Tor^a opeHKa Bexxopa cocxohhhh b momcrx [k + 1) na ocnoBe HHcJiopMapHH yk+i aanninexcH 
cjie^yiomHM oGpasoM: 

-^A:+l|fc+l = Xk+l\k + E[9\^] 

BxipajxaH E[6\^], xax -E'[6'|.^] = E[6] + — -E'[^]), nojiy^HM: 

-^fe+i|fc+i = + Gk+iJ^k+i, 



me 

_ v * TJ “1 

fc+l ^k-\-l\k^k-yi -^k-\-l\k 

Maxpnpa ycHJienHH KajiMana (Kalman Gain) n 

= Eluk+ii^k+i*] = Hk+i\k = Ck+iT.k+i\kCk+i* + Rk+i 

Ha aaxjnonnxejiBHOM sxane {k + 1) mara paccnnxBiBaexcH Maxpnpa omnGxH opeHHBanHH, 
c ynexoM nojiynenHoro HaGjno^eHHH Yk+i- 

cov{d,d\0 = E[{d-E[e\i]){d - Emr] = E[{Xk+i-Xk+i\k+i){Xk+i - Xk+i\k+i)*] = ^k+i\k+i 


TaxHM oGpaaoM, snaH openxn na mare {k), no^cxaBjuiH BBipaacenne ^jih b cJiopMyjiy 

BBime, nojiynaeM cjie^yioipHe pexyppenxHBie cooxHomenHJi BBmncjieHHH openox na {k + 1) 
mare: 

ypaBHeHHa npornosHpoBaHHa: 

Xk-\-l\k ■^kXk\k 

^k+l\k -^k'^k\k-^k ~k Qk+1 

ypaBHeHHa KoppexTHpoBKH: 

^k+1 Yk-i^i Ck-\-lXj^j^i^f^ 

Ek+i\k = Cfc+iSfc+i|fcGfc+i* + Rk+i 
Gk+1 ^k+l\kGk+l Hk+l\k 
-^fc+i|fc+i = + Gk+iJ^k+i 

^fc+l|fc+l G k-\-lGk-{-l)'^ k+l\k 


5 



2.2 Crjia:acHBaHHe KajiMana 


B xo^e oii,eHHBaHHH OK HaGjno^eHHa nocxynaioT nocjie^oBaxejiBHo, xax k mary N y Hccjie^o- 
Baxejia HMeexca HanGojiBinnH o6x.eM HHcJiopMai^HH y^. HxoGbi HcnojibsoBaxb 3xy HH(|)opMan,HK) 
BBe^en ajiropnxM CrjiaacHBaHna KajiMana (CK), Koxopbifi BbiHHCJiaex: 

Xk\N = E[Xk\yN] 

'^k\N = E[{Xk — Xk\]sf){Xk — Xfc|jv)*|3^iv]- 

rioHaxHo, Hxo ^aHHoro ajiropnxMa cocxohx b nojiyneHHH hobbix openoK Bexxopa cocxoa- 
HHH Ha ocHOBe Gojibmefl HH(|)opMan;HH. Tax, ecjiH HMeexca N naGjiiopeHHH, xo openxa OK pjiH 
Bexxopa cocxoHHHH B MOMeHx k+1 BbiHHCJiHexcH xax ycjioBHoe MaxeMaxHHecxoe ojxHpaHHe ox- 
HocHxejibHo yk+i, a b crjiajxHBaHHH KajiMana ona BbiHHCJiHexca xax ycjioBHoe MaxeMaxHHecxoe 
ojxHpaHHe oxHocHxejibHo 3^Ar, npHHeM 3^7 v copepjxHx B ce6e yk+i- 

BbiBop (|iopMyji CrjiajxHBaHHH KajiMana npHnepen b IIpHjiojxeHHH A. CrjiajxeHHbie openxH 
BeXXOpOB COCXOHHHH H CXJiaiXeHHbie OpeHXH Maxpnpbl OHIhGoX, BOSHHXaiOipHX npH paHHOM 
opeHHBaHHH, HaxopHxcH cjiepyioipHM o6pa30M: 

Jk = 

Xk\N = ^k\k + Jk{Xk+l\N — ^k+l\k) 

^k\N = ^k\k + Jk[^k+1\N — ^k+l\k]Jk 

Kax HoxaaaHo b j8], poBepnxejibHbiH HHxepBaji npornosa HeHa6jiiopaeMbix nepeMeHHbix b 
xope opeHHBaHHH CrjiajxHBaHHeM KajiMana y>xe, neM npn opeHnnannH Onjibxpa KajiMana, nxo 
HHxynxHBHO nonnxHO h 3 npen ajiropnxMa. Bojiee xoro, nnjxe 6ypex noxa3aHO, nxo b cjiynae 
rayccoBcxHx omnGox CK paex MeHbmyio cpepnioio omnGxy openHBaHnn, no cpaBnennio c OK. 

3 Mexo^bi oij;eHHBaHH5i napaMexpoB 

IlpepnojiojxHM 3pecb n pajiee, nxo napaMexpni Mopejin ne BaBHcnx ox MOMenxa BpeMenn k, 
xorpa Bexxop napaMexpoB, xoxopbin napo opennxb, HMeex Bnp: 6= [/i, S, A, C, Q, i?] 
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3.1 Mexo^ MaKCHMajibHoro npaB^ono^o6Ha 

HanneM c HeKoxopofi opeHKH Bexxopa 6q. Ilycxb nocjie j maroB HMeeM openKy 6 = h HipeM 
HeKoxopyio jiynmyio opeHKy 9 = SnaH openKy Bexxopa napaMexpoB 9 na npepBipyipeM 

mare, BBiHHCJxieM h hx xoBapnapHOHHBie MaxpnpBi pjiH /c = l,2,...,iV: 

Vk 1) 

Hk\k-i{0) = CEkik-iC* + R 

HecjiojxHo noxaaaxB, hxo Uk HMeex nopMajiBHoe pacnpepejieHne co cpepxHM 0 h xoBapnapHOH- 
HOH MaxpnpeH /],ajiee cxponxca (JiynxpHH npaaponopoGHH, xoxopaa HMeex BHp: 

/I \ 

i-l") = n (4) 

MaxcHMHSHpyH jiorapHcJiM paHHoro BBipajxeHHH, nojiynaeM HOByio openxy 9. nojiyne- 
HHH 3XOH opeHXH Hacxo HCHOJiBsyiox HpopepypBi HHCJieHHOH onxHMHsapHH, HanpHMep npopepy- 
py HbioxoHa-PacJicoHa. OpeHHBaHHe napaMexpoB no Mexopy MaxcHMajiBHoro npaBponopo6H5i 
pjm MopejieH npocxpancxBa cocxohhhh npoHSBopnxcH no cjiepyioipeMy ajiropnxMy: 

1. BbiGnpaioxcH nexoxopBie nanajiBHBie snanennH pjm nexxopa napaMexpoB 6**'°^. 

2. Hcnojibsyn pannBin Bexxop napaMexpoB, c noMoipmo (JiHjiBxpa KajiMana BBinncjiniox 

^k{9^^^) H k = 1,2,..., N. Ha ocnoBe nojiynennBix snanennH BBinncjinexcn 

4)yHxpHH npaBponopoGnn. 

3. Hojiynennan cj^ynxpnn npaBponopoGnn MaxcHMHsnpyexcn (nncjiennBiMH MexopaMn) no 
Bexxopy napaMexpoB [9). B nxore nojiynaexcn nexoxopBin hobbih Bexxop napaMexpoB 

4. Hmoh HOBBIH Bexxop napaMexpoB, noBxopmoxcn marn 2-4 po cxopnMocxn npopepypBi. 

/laHHBiH ajiropnxM cxajixHBaexcn c payMn npo6jieMaMH. Bo-nepanix, na-aa nncnennoH npn- 
popBi naxoJxpeHHH openox pannain ajiropnxM aecBMa BpeMnaaxpaxen. Bo-axopnix, cyipecxayex 
pncx naxoncpenna jioxajiBHoro, a ne rjio6ajiBHoro MaxcHMyMa, nosxoMy npeaBBinanno aancen 
BBi6op nanajiBHBix napaMexpoB pjm opennaanna. Ecjih >xe HHHOBapnH HMeiox ne nopMajia- 
Hoe pacnpepejienne, xo onncannaiH BBime ajiropnxM npn nexoxopBix npepnojiojxennnx MOJxex 
paaaxB cocxonxejiBHBie h accHMnoxnnecxn nopMajianaie openxn, no ynce c ppyron pncnepcnen, 
paHHBiH Mexop naaBiBaexcn Quasi MLE. 
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3.2 EM-ajiropHTM 

BnepBbie ^aHHbifl ajiropHXM 6biji npe^jiGacen b |5]. ero bbibo^b BBe^eM cjie^yiomHe 060- 
3HaHeHH5I. 

IlycTB Ha {J^^),P), r^e P - Hcxo^Haa BepoaxHocTB(reference probability) cjiynaHHBie 

BejiHHHHBi Xk H Y) HesaBHCHMBi fljiH jhoGbix h / h Ho^HHHeHBi cjie^yioipHM saKOHaM pacnpe- 
^ejieHHH. 

Xfc~Ar(0,4); Yi^ATiOJJ 

PaccMoxpHM HOByio BepoHXHOcxB P Ha (fl, xaKyio hxo: 

Xo~A^(/i, E); Xk+i = AkXk + Vk+i] Vk^N{0,Qk) 

Yk = CkXk + Wk, Vbfc~iV(0,i?fc) 

H { 14 } H {Wi\ HeaaBHCHMBi, fljiH Bcex A; H /; OGoanaHHM: 

dP 

-- = At, 
dP 

r^e (onpe^ejieHHe Xk b npHjio:HceHHH B). OGosnaHHM: 

dP 

Q(0,0') ^ Ee,[log^\y^i 

are' 

F^e BeKxopy 6= [/r, E, A, C, Q, i?] cooxBexcxByex BepoaxHocxB Pg, a BeKxopy 9'= [/i', E', A', C, Q', R'] 
cooxBexcxByex BepoHXHocxn Pg. 

Tor^a, obosHanaH E[^\y]sf] = E[AN\y]sf]=L{9), r^e E - MaxeMaxHnecKoe oxcH^aHHe oxho- 
CHxejiBHo HcxoflHOH BepoHXHocxH P H, Hcxo^H H3 HepaBeHcxBa Hencena, nojiynHM cjie^yioipee 
HepaBeHcxBo: 

LogL{e) - LogL{e') > Q{e,e') 

OcHOBHaH pejiB, KaK H panee, cocxohx b xom, hxoGbi HanxH xaKofl BeKxop 6, KoxopniH MaKCHMH- 
3Hpyex L{9). HannHaeM ajiropnxM c neKoxoporo BeKxopa 6^^°^ xorpa na mare j + 1, j >0,3HaH 
npepnipyipyio opeHKy 9^A^ nipeM BeKxop 9^P^\ xaK hxo: 

^(i+i) _ argmax Q(6,6^^A 

( 9 ) 

Ecjih ypaexcH nafixH xaKoe hxo > 0, xo hobbih BeKxop yBejiHHHBaex 3Ha- 

HeHHe (JiyHKpHH npaBpoHopobHH no cpaBHennio c npepnipyipeM ee BHanenHeM. Bbibop (JiopMyji 
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EM-ajiropHTMa npe^cTaBjien b IIpHjiojKeHHH B. OopMyjiBi ^jih opeHHBanHH xaKJKe Moryx 6bixb 
Hafl^eHBi B j6j, 3a HCKjiioHeHHeM (|)opMyjiBi ^jih MaxpnpBi C, xax Kax b [6] ona npe^nojiaraexcH 
H3BecxHOH, Hxo He Bcer^a xax. 

/laHHBiii ajiropHXM xax jxe, Kax h Mexo^ MaxcHMajiBHoro npaB^ono^oGHH, HMeex necxojiB- 
xo MHHycoB. Bo-nepBBix, HeH3BecxHBi cxporne pe3yjiBxaxBi o cxo^hmocxh EM-ajiropnxMa. Bo- 
BXOpBIX, OH OHeHB HyBCXBHXejieH X HanajIBHBIM 3HaHeHHHM. 

4 PesyjibTaxbi CHMyji5iii,HH 

4.1 Ajib(J)a-ycTOHHHBoe pacnpe^ejieHHe 

PaccMoxpHM o^HOMepHyio a-ycxoHHHByio BejiHHHHy. Onpe^ejiHM ee Hepe3 xapaxxepncxHHe- 
cxyio (|)yHXH,HK) |1]: 


log0(t) 


cr"|t|"{l — i/?sign(t)tan—} + ifit; a ^ 1 
2 

-cr|t|{l + i/3sign(t)—log|t|} + ijjLt] a = 1 
n 


(5) 




( 6 ) 


F^e a G (0;2],/3 G [—> 0,/f G -R h a- xapaxxepHcxHHecxaa axcnoHenxa a- napaMexp 
MacmxaGa; /3- napaMexp acHMMexpHH. By^eM o6o3HaHaxB a - ycxoHHHByio cjiyHaHHyio BejiH¬ 
HHHy cjie^yiomHM o6pa30M: X 

Kjiacc a - ycxoHHHBBix pacnpe^ejieHHH 6biji BBiGpan, nocxojiBxy cjiynafi a = 2 h /3 = 0 
(S' 2 (o', 0, yu)) cooxBexcxByex rayccoBcxofi cjiynaHHOH BejiHHHHe c napaMexpaMH pacnpe^ejieHHH 


(/i,2a2). 


CHMyjIHpOBaHHH a-yCXOHHHBOH BejIHHHHBI MBI HCHOJIBBOBajIH MeXOfl, HpeflJIOJXeHHBIH B 
|11) H flOXa3aHHBIH B [3]. 


a ^ 1 



(7) 




arctan{f3tan^) 


a 


H fljiH a = 1 


2 


[(71/2 -|- f3V)tanV — (3log{ 


^WcosV 


)] 


( 8 ) 


71 


{71/2)+pv 
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r^e V - paBHOMepHo pacnpe^ejieHHaH na HHxepBajie [—7r/2;7r/2] (V ~ U[—n/2;n/2]) cjiynafi- 
Haa BejiHHHHa h W - sKcnonenpHajiBHo pacnpe^ejieHHan cjiynaHHaH BejiHHHHa c napaMexpoM 
1 {W ~ Exp{l)), V nW HeaaBHCHMBi. 

4.2 PaccMaTpHBaeMaa Mo^ejib 

HaMH Gy^ex cHMyjiHpoBana h HayneHa Mo^ejiB: 


Xk+l — Axk + €k+i 

(9) 

Vk = Cxk + rjk 

(10) 


Sk ~ S'„(a,/3,0); xo ~ S'«(a2, /3,/i); r]k A/'(0,-R), Sfc H Tji HeaaBHCHMBi ^jih Bcex MOMenxoB 
BpeMeHH k VL I. 

Mbi nojiojKHM pacnpe^ejieHHe HanajiBHoro Bexxopa cocxohhhh a-ycxoHHHBBiM c xeM ace 
napaMexpoM a, axo h y inyMa ypaBHenna cocxohhhh. TaKHM oGpaaoM, Gjiaro^apa xoMy, axo 
cyMMa ^Byx neaaBHCHMBix ajiB(|)a-ycxoHaHBBix BejinanH c o;];hhm h xeM ace napaMexpoM a 
ecxB cHOBa aaBcjDa-ycxonnnBaa Beananna c xeM ace napaMexpoM a, n xoMy nxo yMnoacenne a- 
ycxonnHBOH BeannnnBi na necaynanyio Beannnny nsMenaex xoaBKO napaMexpni a n /x, noayna- 
eM, nxo BeKxop cocxoannn bo Bce paccMaxpnBaeMBie MOMenxBi BpeMenn HMeex a-ycxonnnBoe 
pacnpe^eaenne c o;];nHM n xeM ace napaMexpoM a. 

Panee mbi npe^noaaraan, nxo napaMexpBi, cJmrypnpyiomHe b OK, a HMenno 

[/^) Cki Qki Rki 

B Kaac^BiH MOMenx /c = 1, 2, ... nsBecxnBi, no na npaKxnxe nx neoGxo^HMO opennxB. PaccMox- 
pHM ^Ba Mexo^a opennaanna napaMexpoB paccMaxpnBaeMoro xnacca Mopeaen. 

HaMH paccMoxpeno pna caynaa: caynan, Korpa Bce napaMexpBi nsBecxHBi, n caynan, Korpa 
napaMexpBi neoGxopnMo opennxB. 

/],aa cHMyaapHH Gbihh BBiGpanBi caepyioipne napaMexpBi; 

Xk+i = Xk +Ek+I ] ~ 5 'q( 20 ,/ 3 , 0 ) 

yk = l.2xk + /ifc ; /ifc ~ A/'(0,150) 
xo ~ ^„(50,/3,100) 
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KajK^aa BtiGopKa co^epjKHx N = 1000 HaGjiro^eHHH. JXji^ napaMexpoB an/? Gbijio ncnojiBso- 
Bano cpe^Hee aHaneHne Z cHMyjiapHH [Z 6y^ex MenaxtcH b aaBHCHMocxH ox BBiHHCJinxejiBHbix 
aaxpax ajiropnxMa). 

4.3 Bee napaMGTpbi hsbgcthm 

/laHHaH xjiaBa BKjiioHaex b ceOa npe^BapnxejiBHBie peayjiBxaxBi oMnapHnecKoro Hccjie^oBaHHH, 
npe^cxaBjieHHoro b ini- PaccMoxpHM KaK H3MeHeHHe a M (3 bjikhox na cpe^nioio omnOKy ope- 
HHBaHHH HenaOjiiopaeMBix cocxohhhh. 

Ha PneyHKe 1 {Z = 10000) HaoGpajKena epepnaa omnOKa opeHHBanHH, Koxopaa bbihhcjih- 
exc3 cjiepyroipHM oOpaaoM: 

. . z N 

Error ~ EE(Ar (11) 

m=0 k=Q 



alpha 


Phc. 1: CpepHHH omnOKa (Z=10000 cHMyjiHpHfi) opeHHBaHHH 4>K (KpacHBm) h CK (chhhh). 
a G [0.05; 2], mar=0.05, /? = 0 

Ha PneyHKe 1 mojkho BnpexB, hxo b cjiynae GojiBinoro oxKjioHenHH ox rayccoBCKoro pac- 
npepejieHHH, cpepHHH omnOKa npepcKaaaHHH pacxex, nanpHMep, pjiH a = 1.5 cpepHHH omnOKa 
opeHHBaHHa b 6 paa 6ojiBme, hom pjiH rayccoBCKoro cjiynaH. Ha-aa orpoMHBix aHaneHHH epep- 
HeKBappaxHHecKoii oiuhOkh, rpa(|)HK epepneii oiuhGkh b HHxepBajie a G [0.1 : 2] BBirjiapnx kbk 
KOH cxanxa, noaxoMy npepcxaBjieHBi rpacjDHKH oiuhGkh pjia MeHBinnx HHxepBajioB napanexpa. 
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SaMCTHM, HTo ®K He THK HyBCTBHTejieH K H3MeHeHHio a B HHxepBajie [1.85; 2], xaK, nanpHMep, 
fljiH a = 1.85 cpe;];HHH cyMMapnaH oninGKa Boapacxaex na 20%, saxeM HaKjioH kphboh xojibko 
pacxex. JlexKo BH^exb, hxo 3xoro ace ^Hanaaona aHaneHHH a CK ^aex Mentniyio omnOKy 
opeHHBaHHH no cpaBHennio c OK. 3xo oOx-ncHnexcn xeM, nxo ^jih naxonc^eHnn openoK CK, 
HeoOxopHMo BHOBb HOJibsoBaxbCH xayccoBocxbio o ttt hOok. 

EpHHcxBeHHbiii napaMexp, Koxopbifi ne 6biji ycxaHOBjien hcxhhhmm - 3xo napanexp a pac- 
npepejieHHH ohihGok ypaBHenna cocxohhhh. no3XOMy jioxhhho npepnojioJKHXb, nxo Gojibman 
omnOKa cBaaana c HecoGjiiopeHHeM npepnocbuiKH rayccoBocxH ohihGok. Bojiee xoro, mm npep- 
HOJiaraeM, nxo 3xa omnOKa Moncex Gbixb o6x.HCHeHa nepoopenKOH samyMjienHocxH nenaOjiiopa- 
eMOH nepeMeHHOH. Hxo6bi 3 x 0 nonnxb, pocxaxoHHo cpaBHHXb a -ycxoHHHBoe pacnpepejienHe h 
rayccoBCKoe pacnpepejieHHe c ophhm h xcm nee napanexpoM erj^ IIocjiepcxBHH npepnojiojKeHHH 


alpba=2 alpha=1.95 alpha=1.85 



-400 -200 0 200 400 600 2000 -1000 0 1000 2000 -1.0eP)7 -5.0e*06 0.0e*00 5.0e*06 1.0e*07 1.5e'P)7 


Phc. 2: 5IpepHbie opeHKH hjioxhocxh a - ycxoHHHBoro pacnpepejieHHH (chhhh)( cr = 20; /3 = 0) 
H HopMajibHoro pacnpepejieHHH (KpacHbin) c xeM nee napaMexpoM a. 

rayccoBocxH pacnpepejieHHH, Korpa oho na caMOM pejie ajib(|)a-ycxoHHHBoe, npepcxaBjieHbi na 
PHcyHKe 2. HxoGbi nojiynHXb opeHKH OK mm saMenneM a-ycxoHHHBoe pacnpepejieHHe, apep- 
Hbie opeHKH HJIOXHOCXH Koxopoxo HpepcxaBjicHM CHHHM pBexoM, Ha rayccoBCKoe pacnpepejie- 
HHe c xaKHM jKe napaMexpoM a, hxo cooxBexcByex KpacHOH jihhhh. OpnaKo, pjiHHHbie xbocxm 
HcxHHHoro pacnpepejieHHH ne noKpbiBaioxcH rayccoBCKHMH, b peayjibxaxe nero cxanpapxHbiH 
ajiropHXM Onjibxpa KajiMana ne mojkcx pacnosHaxb hpmjkkh npopecca. JlexKo saMexHXb, hxo 
npH npHOjiHHceHHH a K 0, xbocxm pacnpepejieHHH cxanoBHxcH "xHJKejieen nepoopeHKa paa- 
6poca aHaHeHHH cxanoBHxcH Bce Oojibme h, KaK cjiepcxBHe, omnOKa Boapacxaex cHjibHee. B 
xepMHHax Onjibxpa KajiMana, ajiropnxM paccMaxpnaaex ypaBHenne cocxohhhh nepocxaxoHHo 

^FayccoBCKaH cjiynaiiHaH sejiHHHHa CHMyjiHpoBajiacb MexopoM BoKca-Mrojijiepa, h a-ycTOHHHBaa c.b. CHMy- 
jiHpoBajiacB, KaK b |3] 
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samyMjieHHbiM h npHnnctiBaeT MeHbniHH Bee (YcHJieHHe KajiMana) nojiynenHOMy HaGjno^eHHio. 

Cpe;];HHH oGipaH omnGKa pasHBix napaMexpoB /3 h (|)HKCHpoBaHHoro a H3o6pa>KeHa 
Ha PneyHKe 3. JlerKo BH^exH, hxo cjiynan cHMMexpHHHoro pacnpe^ejieHHH {f3 = 0) ne co- 



Phc. 3: Cpe;];HHH cyMMapnaH oninGKa (10000 CHMyjiHpHH) opeHKH OK (KpacHBifl) h CK (chhhh). 
/9 G [—1;1] mar=0.05 a = 1.75 

oxBexcxByex caMofl MajieHBKofl epe^nefl omnOKe. Cjiojkho cKaaaxB, hxo Meac^y ohihGkoh h 
napaMexpoM f3 ecxB KaKaa-xo aaBHCHMocxB. Bojiee xoro, poex ohihOkh ne xaKofi Gojibhioh, KaK 
npH H3MeHeHHH napaMexpa a, noaxoMy b cjie^yiomeH naexH mbi nepeKjiioHHMCH xojibko na ero 
H3yHeHHe. 

4.4 Oi],eHHBaHHe napaMexpoB 

PaccMoxpHM HOBefleHHe ^Byx npope^yp opeHHBaHHH, Koxopnie 6 bijih onHcaHBi BBime: Mexo^a 
MaKCHMajiBHoro npaB^onofloGHH (MLE) h EM-ajiropnxMa. HanajiBHBie 3HaHeHHH b3hxbi na 
ypoBHe HcxHHHBix 3HaHeHHH, H Hama pejiB H3yHHXB, KaK ceGa openKn]^ 

Ha PneyHKe 4 mojkho BHpexB, hxo cpepHHH omnOKa pacxex paxce npn HeGojiBmnx oxKjione- 
HHHx ox a = 2, xo ecxB ML openKBanne Kpanne nyBcxBHxejiBHo k oxKjioneHHio ox rayccoBCKoro 
cjiynaH. H3-3a pa3Horo nopnpKa omnOKH b xope ML opeHHBaHHH h EM opeHHBaHHH, mbi h3o 6- 
pa3HjiH omnOKy nojiyneHnyio b xope opeHHBaHHH EM-ajiropnxMa na PneyHKe 5. 

KaK BHpHo H3 PneyHKa 5, omnOKa opeHHBaHHH OK paexex MepjieHHo b HHxepBajie [1.3;2], 
HanpHMep pjiH a = 1.4 omnOKa BBipoejia xojibko na 12.5% (b epepneM, no epaBHennio e raye- 

^Hs-sa BbiHHCjiHTejibHbix saxpaT onTHMHsapHH OyHKpHH npabponopoGHH, hhcjio CHMyjiHpHii 6bijio Bbi6paHO 
paBHbiM 1000 
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Phc. 4: Cpe^HHH o6iri;a3 oninGKa (1000 cHMyjiapHil).OpeHKa napaMexpoB MLE (KpacHtm) h 
EM (cHHHH).a G [0.1; 2], mar=0.1 /? = 0 



Phc. 5: Cpe^HHH oninGKa ®K (1000 CHMyjiHpHH). EM (chhhh) opeHHBaHHe napaMcxpoB. a G 
[0.1;2], mar=0.1 /3 = 0 

coBCKHM cjiynacM), xor^a kbk 6e3 npHMeHeHHH ajiropnxMa opeHHBaHHH ona BBipocjia npn- 
6jiH3HxejiBHo B 15 pa3, xaKHM o6pa30M MOJKHO yxBcpjK^axB, Hxo nojiyHCHBiii pe3yjiBxax ynce 
y^oBjiexopHxejiBHBiH. OflHaKo, 3a npe^ejiaMH ^aHHoro HHxepBajia oninGKa ynce 3HaHHxejiBHo 
B03pacxaex, ho Bce paBHo MCHBrne, hcm omnOKa npn ML opeHHBaHHH. HxoGbi hohhxb noncMy 
EM opeHHBaHHe ^aex Gojiee y^oBjiexBopHxejiBHBiH pe3yjiBxax, paccMoxpHM rpa(|)HK opcHHBae- 
MBix napaMcxpoB (PncynoK 6). 

KaK MOJKHO BH^exB H3 PHcyHKa 6, EM ajiropHXM ^aex Gojiee y^oBjiexopHxejiBHBie pe3yjiB- 
xaxBi opeHHBaHHH napaMcxpoB. AjiropnxM nepeopeHHBaex Maxpnpy Q (b cpaBHCHHH c rayc- 
coBCKHM cjiynacM), xaKHM o6pa30M, hxo HaOjHo^eHHH pacno3HaioxcH OnjiBxpoM KajiMana KaK 
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Phc. 6: Cpe^HHe opeHKH napaMexpoB (1000 cHMyjiapHn) MLE (KpacHtm) h EM (chhhh).^ G 
[0.1;2], mar=0.1 /3 = 0 

6ojiee samyMjieHHbie, hto npHBo^HT k GojiBineMy Becy HaGjno^eHHH b opeHHBanHH HenaOjiiofla- 
eMoro C0CT03HH5I, HTo cooTBexcByex yBejiHHeHHK) sHaHennH napaMexpa G - ycHJieHna KajiMa- 
Ha. AnajiorHHHBiH peayjiBxax 6biji nojiynen npn cJiHKCHpoBaHHH Bcex ocxajiBHBix napanexpoB 
H opeHHBaHHH xojiBKo MaxpHpBi Q c noMoipBio EM ajiropHXMa. Ecxecxaenno, xax xax na- 
paMexp Q xenepB GojiBine, 3xo pacniHpjiex ^oBepHxejiBHBm HHxepBaji Hamero npornosa, ho 
B cHMyjiHpoBaHHOM HpHMepe 3XOX pocx flOBepHxejiBHoro HHxepBajia bbixjih^hx npHeMjieMBiM, 
xaK, HanpHMep, ^jih a = 1.4 mbi chhshjih cpe^Hioio omnOKy opeHHBaHHH b Gojiee hbm b 13 
pa3, xor^a Kax BBipocjia xojibko b 1.15. K cojKajieHHio, ^aHHOH nepeopeHKH ne^ocxaxoHHo 
ripH OojIBHIHX OXKJIOHeHHHX a. O^HaKO, MBI npeflX.HBHJIH flOCXaXOHHO OojIBinOH HHXepBajI B03- 
MOJKHBIX 3HaHeHHH tt, flJIH KOXOpOXO MOJKHO HpHMeHHXB CXaH^apXHBie Hpope^ypBI OpeHHBaHHH 
napaMexpoB h opeHHBaHHH HenaOjiioflaeMBix cocxohhhh. 

5 SaKjiiOHeHHe 

B ^aHHOH Ha cHMyjiHpoBaHHOM npHMepe Gbijio noKa3aHo, hxo nenpaBHjiBHaH cnepncJiHKapHH 
myMOB ypaBHeHHH HaGjuo^eHHH 3HaHHxejiBHo yBejiHHHBaex oniHGKy opeHHBaHHH HenaOjiioflae- 
MBix KOMHOHeHx, HpHHeM oHinGKa pacxex Gbicxpee hbm jiHHeflHo, npn H3MeHHH napaMexpa a. 
noKa3aHo, HXO EM-ajiropHXM mojkcx opennxB ^HcnepcHio inyMa npn HeBepHoil cnepncJiHKa- 
pHH ohihGok xaKHM o6pa30M, HXO omnOKa opeHHBaHHH HenaOjiioflaeMoro Bexxopa B03pacxaex 
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Me^jieHee. Tax, omnGKa on,eHHBaHH5i npn a = 1.4 BospacTaex Bcero b 1.125 b cpaBHennH c rayc- 
coBCKHM cjiynaeM, npn npneMjieMOM yBejiHneHHH ^oBepHxejiBHoro HHxepBajia. ^aHHBifi bbibo^ 
roBopHx o xoM, Hxo fljiH flOBOJiBHo 6ojiBmoro HHxepBajia aHaneHHH a Moacex 6bixb HcnojiBsoBan 
OnjiBxp KajiMana co cxan^apxHOH npope^ypofi opeHHBanHH napaMexpoB EM-ajiropnxMOM. 
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IlpHjioiHceHHe A 


PeKypcHBHaa cJjopMyjia flJia Xk\N- 

06o3HanHM, 9 = Xk - Xk\k h ^ 

SaMexHM, UTO 9 a ^ obpasyioT rayccoBCKnn cjiynanHnm neKTop. OGoananan, 


Vi 


Vee 

% 


Em=E[9] + Vo^V^f^[^-E[^]]. 


3ppch 

= ^k\kA*f, 


Tor^a 

Xk Xk\k (A'/j_|_i Xk-\-\\k) 

Bo3bMeM ycjioBHoe MaxeMaxHuecKoe oacH^anne i?[...|3^7v] ot jibboh h npaBon nacxn n nojiy- 
uhm: 


Xk\N — d^k\k — Jk{Xk+l\N — Xk+l\k)i 

r^e Jk = 

d^k\N = Xk\k + Jk{Xk+l\N — Xk+l\k) = {I ~ JkAk)Xk\k + Jk^k+pN 

Tax KaK opeHKa A^iat b BBipancennH BBime aaBncnx ox Xfc+i|jv, crjiaacHBanne nponaBo^nxcn 
Haunnan c npe^nocjie^nero ananennH. 
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PeKypcHa flJia Tjk\N 

Ha nojiynenHoro panee ypaBHeHHH: 

— Xk\N = Xk — Xk\k — Jk{Xk+l\N — ^kXk\k)i 


HMeeM: 


Xk — Xk\N + JkXk+l\N — Xk — Xk\k + Jk^kXk\k- 
HaH;];eM KOBapHapHOHHbie MaxpapBi BBipaacennH cjieBa (LHS) h cnpaBa(RHS). 


HcnojiBsyn to, hto 


H 


nojiyHHM 


E{{LHS){LHSr) = T.k\i + 

k+l\N)Jk- 


E{Xk+iXlj^i) — T^k+I\i + E{Xk+i\NXl^^^^) 


E{Xk+iX:^,) = AkE{XkXl)Al + 


E{{LHS){LHSy) = T.k\i + Jk{AkE{XkX;)Al + Qk+i - S^+nO4* 


AnajiorHHHo, 

E{{RHS){RHSr) = Sfeifc + JkAk{E{XkXl) - J* 

HpnpaBHHBaH o6e hbcth, nojiy^HM: 

Sfc|Z = Sfc|fc + Jk\y^k+l\l — '^k+l\k]Jki 


r^e 

Jk = '^k\kAk'R‘k^i\k- 

SaMOTHM, HTO MaxpHpBIBI Sfc|fc,Sfc+i|fc H Jfc H3BeCTHBI H3 ®K, H TOJIBKO MaxpHpa Sfc+i|z 
HeH3BecTHa. To ecxB b ^anHOM cjiynae aHaHenne MaxpapBi oiuhGkh b nepno^e k, aaBHCHx ox ee 
3HaHeHHH B k+1 nepHo^e, 3HaHHT naxoac^eHne ^aHHBix crjiajKenHBix openoK npoH3BopHTCH c 
KOHpa. 
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HeKOTopbie nojiesHbie pesyjibTaTM h 3 ajiropHTMa crjia>KHBaHHa 

06o3HaHHM KOBapHan;HOHHyio Maxpnpy Meac^y napofi coce^HHx openoK Bexxopa cocxohhhh 
npH crjiajKHBaHHH, cjiepyioipHM o6pa30M; 


^k,l\N — E[{Xk — Xk\N){E^l — 


rpe k,l < N 
HcnojiB3y5i 

^N,N-l\N = (/ — GNCN)A]sf-i 

KaK HanajiBHoe ycjioBHe(3HaHeHHe H3BecxHo h3 OK), KOBapnapHOHnyio Maxpnpy crjiajKHBanHH 
pjiH cocepHHx openoK Bexxopa cocxohhhh mojxho paccHHxaxB xax; 


^k-l,k-2\N — ^k-l\k-l'Jk-2 + 'Jk-l[^k,k-l\N — Ak-l^k-l\k-l]'Jk-2 


npHjio:»ceHHe B 


06o3HaHHM Qk = ■■■,Elk} CHXMa-ajixeGpy nopojxpeHHyio Xq, ... ,Xk, E - MaxcMaxH- 

HCCXOe OJXHpaHHC OXHOCHXejIBHO HCXOpHOH BCpOHXHOCXH P VL E - MaXCMaXHHCCXOe OJXHpaHHC 
OXHOCHXejIBHO BCpOHXHOCXH P H 


dP 

dP 


A 




rpe At=nLo H Afc, xaxne hxo: 


1- Afc ^fc-H3MepHMa 

2. Afc>0 C BCpOHXHOCXBK) 1. 

3. E\\k+i\Qk] = 1 

4. ^[Ao] = 1 


Torpa BcpHo cjiepyiomee cooxhohichhc pjiH MaxcMaxHHccxoro ojxnpaHHH nexoxopoH cjiynaHHOH 
^fc-H3MepHMOH BCJIHHHHBI A; E[A\ = ^[AjA] IlyCXB (^{x) XayCCOBCXaH 4)yHXpHH HJIOXHOCXH 
A/’(0,/„), H '^(y) rayccoBcxan hjiocxhocxb A/'(0,/m). BxipaBHM nepBBiH hjich At, Aq: 


An — 


|S|-V20(s-V2(Xo - ^)) - CM) 


0(Xo 


M) 
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Ao=Ao k > 1 


Ai, — 


- Ak-iXk-i) - CM) 


Mk) HXk) 

Alajiee npe^nojiojKHM, hto napaMexpL.: Mo^ejiH 6k ne saBHCHx ox MOMenxa BpeMenn k: 6^ = 9. 


E-mar 

dP 

Q{9,d') = Ee'[log—^\yN], r^e O'M) 

ai^gi 


log 


dPe 

dPgi 


N 

logAe - logAgi = ^ logXi + C{6'), 
1=0 


r^e C{d') - KOHcxanxa, ne saBHCHipaH ox Bexxopa napaMexpa 6. 

^ 1 1 

logXi + C{9') = --logm - -(Xq - p)*S-'(Xo - p)- 

N 

-^^^log\R\ - CXk)*R-\Yk - CX^)- 

^ fc =0 

N 1 ^ 

-^log\Q\ - 2 Y.^Xk - AXk-irQ-\Xk - AXk-i) + C{e') 

^ k=l 

Hafi^eM ycjioBHoe MaxeMaxH^ecKoe oacn^aHHe ^aHHofi BejiHHHHBi: 

^0'[^o^^|3^iv]= -]^log\'L\ - ^ ^^ log\R\ - ^log\Q\ 

1 ^ ^ 

--trace[Q-^E[Y^{Xk - AX^Xk - AXM^] + 0(6') 

k=l 

1 ^ 1 
— -trace[R~ ^ElJ^iXk - CXk)iYk - CXk)*\yN]] --traceME[{Xo - g){Xo - p)*^ 


M-mar 

MaKCHMHsnpyeM nojiyHennyio 4)yHKn;Hio. Hepe^ hohckom onxHMajiBHBix napaMexpoB ccjiop- 
MyjiHpyeM ^Be jieMMBi: 


JIsMMa 1. Ecjih Z = ^[ZlA’] mV = E[{Z — Z){Z — Z)*\y], xo cnpaBe^jiHBo cjie^yiomee 
paBencxBo: 

E[zz*\y] = v + ZZ* 

JIsMMa 2. riycxB (JiyHKpHH f\S) = log\S\ — trace[SU] onpe^ejiena na cBoefi oGjiacxn onpe- 
^ejieHHH P{f), cocxoHipeH hs nojiojKHxejiBHo onpe^ejieHHBix cHMMexpHHHBix MaxpHn; n x n, 
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U - HeoTpHii,aTejit>Ho onpe^ejieHHaH Maxpapa, xorpa T>{f)- Bt.inyKjio, / - BorHyxa na 'D(/)h 
M aKCHMyM f pocTHraexcH npn S~^ = U. 

^OKaaaTejiBCTBa panHBix jibmm npHBepeHBi b [B]. 


OpeHKa /i 

CorjiacHo JleMMe 1: E[{Xo - /i)(Xo - /i)*|3^Ar]]=So|Ar + (Xqiat - /i)(Xo|7v - /^)*, 
trace[E-^E[{Xo - p)(Xo - /Lt)*|3^Ar] = trace[S“^So|Ar] + trace['E-^{Xo\N - /i)(-^o|7v - 1^)*]- 
Tax KaK h (-^o|Af ~ f^){^o\N — f^)* flBe cHMMexpHHHBie, HeoxpHpaxejiBHo onpepejienHBie 
MaxpHpBi, TO cnpaBepjiHBo cjiepyroipee HepaBencTBo: trace[S“^(Xo|Ar — /^)(-^o|Af “ t^)*] > 0. 
SnaHHT, jl = Xo|Ar. 


OpeHKa MaTpHii,bi C 

E[{Yk-CXk){Yk-CXky\yN]=E[YkYC\yN]-CE[XkY*\yN]+CE[XkXl\yN]C*-E[YkXl\yM]C*. 


SaMeHHM: 

N 


B[(n - CXt){Y„ 


N 


N 


K- EiJ^YkXliyN] = -N; = M-C 

k=0 _ _ _ 

- CXk)*\yN]= (c + C)M{C + C)* + K- CMC* 


NM nojiyHHM 


^ajiee: 

trace[R-^E[Y:t,{Yk - CXk){Yk - C'Xfc)l3^iv]]= trace[R-\C + C)M{C + C)*] + F, rpe 
E He saBHCHT ox C. CnpaBepjiHBo HepaBeHcxBo: trace[-R“^(C + C)M{C + (5)*] > 0, xo ecxB 

C = -C. 

N N 

c = -BE A'anrw])-' 

k=0 k=0 


N N N 

E[Y,xi\y„\= Y,Xl^„ 

k=0 k=0 k=0 

IIpHMeHHH JleMMy 1, HOJiyHHM: 

N N N 


{EiYXtXi\yK]}= YElx,xi\y^]= YPhn + 

k=0 k=0 k=0 

TaKHM o6pa30M, b xepMHHax crjiajKeHHBix openoK KajiMana, BBiHHCJieHHBix c HcnojiBsoBa- 
HHeM 6: 

N N 




-1 


k=0 


k=0 
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Oij,eHKa MaTpHLi,M A 

JXjis Toro, htoGm nojiy^HTt oii;eHKy TeopexHHecKoro Bt>ipa>KeHHH ^jih MaxpEpbi A, neoG- 
xo;];hmo noBxopnxb xe ace onepapHH, axo ^ejiajincB panee ^jih opeHHBanHH MaxpnpBi C ^jih 
cjie^yiomero BBipaaceHna: 

EiEtii^k - AXk-i){Xk - AXk-iYiyN]. 

B npe;];Biflyin;eM ajiropnxMe HeoGxo^HMo saMenHXB na X^, C* na A h X^ na Xk_i. Hojiy- 
hhm: 


N 

A = (^[Efe,fc_i|Ar + Xfc|ArXfc_;^|jv])(y^[Sfc-i|Ar + ) 


N 


-1 


fc=l 


k=l 


Oii,eHKa MaxpHu,!.! E 

BBinnineM aacxB hcxo;];hoh (JiyHKpHH, b Koxopofi npncyxcxByex hckombih napaMexp E. 
-^logm -^trace[J:-^E[{Xo - g){X, - /i)*|3^iv]. 

B o6o3HaaeHHHx JleMMBi 2, S = E“^ n U = -E'[(Xo — h){Xq — /i)*|3^Ar], xor^a: 
f{S) = [logS — trace[SU]]. 

Ho JleMMe 2, MaKCHMyM ^aHHofi (JiyHKpHH ^ocxnraexcH npn E = [/, nojiyanM: 

E = -E'[(Xo — /u)(Xo — /i)*|3^Ar], H no JleMMe 1: 

E = E[{Xq — /i)(Xo — /i)*|3^Ar] = Eo| 7V + (-^0|Ar “ /^)(-^0|iV ” /^)*- 


S = 


EqIAt 


OpeHKa MaxpHu,!.! R 

Bnipaacenne nacxn hcxo^hoh (JiyHKpHH, co^epacan^ee R, HMeex bh^: 

N 

AT \ ] 1 

- ^log\R\ - -trace[R-^E[J2iyk - CXk){Yk - CX^yiyN]] 


k=l 


B oGoananennax JIbmmbi 2, S = R ^ h U = 


1 


N 


A + 1 


E[J2{Yk - CX,){Y, - CXkTiyN]] 


k=l 


A + 1 A + 1 

— - — f{S) = —-—[/ogfIRI — trace[SU]], n MaxcHMyM (J^yHKpnn f(S), ^ocxnraexca npn 
R=U. IIoflcxaBaaa nonyaennoe panee xeopexnnecKoe BBipaacenne C n Gepa MaxeMaxnne- 
CKoe oacH^anne, noaynnM: 


N 


N 


N 


R = 


A + 1 




k=0 


k=0 


k=0 


22 



Oii,eHKa MaTpHLi,M Q 

BbinnineM nacTb 4)yHKii;HH, co^epacamyio Q; 

-^log\Q\ - \trace[Q-^E[Y,u=i{Xk - AXk-i){Xk - 

SanHineM ^anHoe BbipaacenHe b xepMHHax JIbmmbi 2, r^e S = Q~^ vi 


U = j^E[Y,^^^{Xk - AXk-i){Xk - AXk-i)*\yN]], Tor^a onxHMajiBHoe Q = U, to 


ecxB; 


N 


Q = - AXk-i){Xk - AXk-iTiyN]] 


k=l 


N 


Q = — 

^ N 


[^[SfclAT + Xk\NXl\p^- 


k=0 


N N N 

-l|Af + -^fc-l|iV-^fc-l|Ar) -'EP- l,fc|Ar + Xk\NXl_^j^] 
k=l k=0 k=l 
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